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ABSTRACT 

This report focuses illustratively on two 
institutional concerns for which changes in the aptitude level of 
entering students may have implications-attrition and grading. 
Implications indicated that colleges, individually and collectively, 
need to develop systematic programs for monitoring the incidence and 
determining the etiology of attrition. Findings point up the need for 
defining and using criteria or standards of student accomplishment 
and achievement which will permit evaluations that are independent of 
current class norms. A fivs-item bibliography is inc],uded. (MJM) 
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DESPITE TRADITIONAL INSTITUTIONAL PRACTICE TO THE CONTRARY, institutional-educational research, 
evaluation, and self-study should be perceived as continuing processes, and implemented accord- 
ingly. Colleger, are dynamic institutions, with changing clienteles, inputs, outputs, education- 
al arrangements , resources, needs, and objectives. They should be' able, at any time, to ascer- 
tain their current status on such variables, relative to their own past status and the current 
and past status of other coller^s. 



CRC at ETS BELIEVES THAT THIS STATE OF AFFAIRS CAN BEST BE REALIZED 
INSTITUTIONAL COOPERATION, jointly planned with central coordination 
to (a) introduce certain common patterns of data collection, evaluat 
of regular institutional practice, and (b) develop policies, and he! 
pooling centrj^ally and sharing comparable data for evaluation and pla 

COLLEGES PARTICIPATING IN CRC'S PROGRAM HAVE ADOPTED PROCEDURES FOR 
in a variety of areas. All colleges use a standard, multipurpose su 
class. Annual surveys of seniors provide data on students' postgrad 
their opinions on perennial or novel educational or societal q-Jiestio 
ious aspects of college life, and other matters. And, the colleges 
surveys, but also data on student progress (e.g., grades, graduation 
achievement on standard tests, etc.). 
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,THESE ARRANGEMENTS HAVE PROVIDED INTERINSTITUTIONAL 
PERSPECTIVE for data interpretation^ and they have 
had the continuity required to assure oritioally im- 
portant time perspective for monitoring trends in the 
basic institutional varidbles under consideration. 

RELIABLE INFORMATION ABOUT TRENDS IN INSTITUTIONAL 
VARIABLES contributes not only^ to a fuller apprecia- 
tion of the dynamic nature of a college (and of the 
corresponding need for continuous assessment) ^ hut 
also to better-informed evaluation of institutional 
practices and problems, 

FOR EXAMPLE^ THE ACADEMIC APTITUDE LEVEL OF STUDENTS 
entering some colleges varied markedly between 19 BO 
and 1970^ increasing dramatically duHng the 1950 's^ 
peaking in the mid-1960 's^ and stabilizing or 
declining thereafter. 

THIS ISSUE OF CENTER NOTES FOCUSES ILLUSTRATIVELY ON 
TWO INSTITUTIONAL CONCERNS for which changes, in the 
aptitude level of entering students may have impHca- 
tio72Sj namely y ''attrition" and "grading standards." 

Kenneth M. Wilson, Director, CRC at ETS 



Colleges atrci dynamic 
institutions 



en 

u 
m 

m 
o 



4J 
4J 

to 



4J 

(0 

ca- 

H 
Q 

O 



FILMED FROM BEST AVAILABLE COPY 



ERIC 




1*JJ liO mJ 1970 

Year en ue red 



u s, DEPAHTMBNT Or HEALTH 
EDUCATJON ft WEtPARE 
OFFiCE OF EDUCAIION 
I^jlS DOCUMCNr HA[3 Bfri'N HfPfKJ 
DUCED EXACriY AS RLLllJVtD FROM- 
' THI PERSON OR ORG ANIMATION ORIG 
INAflNG tr POINTS Of VICw OR OP(N 
■ )ONG STATEO DC NOI NECi'SSARIl Y 
Rf PRESENT OKnCtAL OfFtCE Of- FDU 
Ca 'ION POSITION OR, POLICY ■ 



COLLEGE RESEARCH CENTER □ An Agency for Interinstituti 

Research □ In affiliation with Educational Testing Service, 



onal Cooperation in Institutional 

Princeton. New Jersey 0S54O 



♦♦♦LOSS OF STUDENTS THROUGH ATTRITION IS COSTLY FOR A COLLEGE. CONSIDERING THE AMOUNT OF TIME 
ENERGY, AND MONEY SPENT IN THE RECRUITMENT-ADMISSION PROCESS, THE PROBLEM OF ATTRITION CANNOT ' 
BE IGNORED. NO COLLEGE CAN AFFORD TO BE COMPLACENT, FOR ONE ERA'S GAIN IN INSTITUTIONAL HOLDING 
POWER MAY NOT BE A PERMANENT LEGACY. 



DURING A PERIOD OF ANNUAL INCREASES 
IN THE ACADEMIC QUALIFICATIONS OF THEIR 
ENTERING STUDENTS, Colleges 1 and 2 as 
well as several others studied by CRC, 
realized an improvement in their hold- 
ing power--more objectively, fewer of 
their students withdrew officially. 

FOR EXAMPLE: 

^At College 1, about 69% of the 
class entering in 1958 graduated^ 
while 81% of the class entering 
in 1964 (and about SO points 
higher on the SAT scale) did so, 

^At College 2^ about half (51%) of 
the 1958 entrants persisted through 
graduation^ but almost tHree- 
fow^ths (74%) of the group enter- 
ing in 1964 (and about 90 points 
higher on the SAT scale) did so. 

AT BOTH POINTS IN TINE, College 1, 
relatively more selective than College 
2,, had a higher graduation (lower at- 
trition) rate. This is consistent with 
the general "predicting principle" that, 
at any given point in time, more-selec- 
tive colleges tend to have lower attri- 
tion rates than less-selective colleges. 



Aptitude It^'els and graduation rates for these 
two colleges went up together. Is there 
another side to the coin? 
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Note: Data in this tahle are from Alexander Astin, "Recent Find- 
ings from the ACE Research Program! Implications for Col- 
lege Choice and Admission," College and University * Summer 
1969, pp. 34U356.; ~" 



ASTIN GROUPED 160 COLLEGES ACCORDING TO 
SEVEN SELECTIVITY LEVELS and reported the 
percent of 1966 freshmen not returning: 

<^For colleges at the highest selectivity 
levels only about 5% of 1966 freshmen 
failed to reenroll for a second year^ 
while for colleges at the lower end of 
the selectivity continuwn^ almost one- 
third of the freshman class did not re- 
enr.o 1 1 . 

CRC FINDINGS INDICATE CLEABLY THAT COL- 
LEGES MAY EXPERIENCE DRAMATIC CHANGES IN 
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"SELECTIVITY LEVEL'' OVEI^ A PERIOD OF YEARS, AND THAT GRADUATION-ATTRITION RATES ALSO CMNGE. 
Yesterday's statistics on both variables provide essential historical perspective, at both nation- 
al and institutional levels, but historical perspective is useful primarily as a frame of ref- 
erence for the evaluation and interpretation of today's data . 

ATTITUDE LEVELS Am GRADUATION RATES FOR SEVERAL COLLEGES WT UP TOGETHER? WHAT IS ON TEE 
OTHER SIDE OF THE COIN? 

DATA SUPPLIED BY PARTICIPATING COLLEGES indicate that in several instances graduation rates for 
Classes entering after 1964 {the entering group which registered the highest graduation rate in 
recent years) are on the downswing. 

-^At College 2^ for example^ the graduation rate for the Class 
entering in 1968 (62%) was dawn from the high (74%) attained 
for the Class entering in 1964^ though still considerably bet- 
ter thas^i the grdduation rate (51%) observed for the W'68 
entering group. 

"^At College Z (see first page for trends in aptitude), 81% of 
the freshmen entering in 1964 graduated from the college of 
original registration^ whereas only 51% of 1968 .entrants did so. 

THE SAME GENERAL PATTERN HOLDS FOR THE APTITUDE LEVEL OF ENTERING CLASSES IN THESE YEARS. 
However, it is necessary to resist the temptingly simple .conclusion that "students with higher 
ability persist, while those with lower ability drop out"--that tha patterns which have been 
observed are a simple function of differences over time, and among colleges, in the recruitment 
of high-ability students . 

^Over the years under consideration, withdrawing students at 
these colleges have heen found to have better academic 
credentials than many of their persisting classmates. Few 
students ay*e disiviss^^d for academic difficulties, a:id depar- 
tures from the college of original registration (COB) are 
largely self-initiated. Note also -^'hat Colleges 2 and 3 
have had different graduation rates although their selectivity 
levels aj*e comparable. 

WE MUST BOTHlOOK AT AND LOOK BEYOND "ACADEMIC ABILITY" in an effort to explain observed changes 
in graduation-attrition rate for a given college over time (not to mention differences among 
colleges on this variable). 

IT SHOULD BE RECOGNIZED THAT TRADITIONAL PRESSURES TOWARD C&iVi iNUITY OF ATTENDANCE AT ONLY ONE 
COLLEGE, "ENTERING AND GRADUATING WITH ONE*S CLASS," ARE TODAY BEING ATTENUATED. Varix}Us pro- 
grams conducive to increased interinstitutional mobility are being introduced. For example, 
CRC colleges (and others) are participating in student interchange programs. While these 
may have the effect of reducing attrition by offering students a wider collegiate experience 
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without a severance of ties with their original institution, a general looseninc] of ties to 
only one college is Implicit in such arrangements. 

^Many entering freshmen (74% in 1971) and seniors (88% in 1972) 
in colleges surveyed by CRC endorse the proposition that it 
would be educationally beneficial for students to attend more' 
than one college. 

^ More than half the seniors surveyed in 1972 reported that they 
actually had attended more than one college. 

LEAVING THE COLLEGE OF ORIGINAL REGISTRATION (WITHDRAWING OFFICIALLY) is an option which students 
may exercise at their discretion, and one which a majority of them consider at one time or another 

especially as freshmen or sophomores. 

Students who actually withdraw fron their college represent only the visible 
tip of an 'attrition Iceberg.' CRC surveys reveal that a majority of con- ^ MOre thOH a third (37%) Of 

ulng students conalder the poagiblllty of Graving from college. SeniorS SUWeyed in 1972 re- 
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to a survey lte« 1968 19fe9 1969 1969 X971 1972 ^^iU an additional 31% hod 
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^l^en it is realised that act- 
ual student attrition in 
these colleges currently " 
ranges between 20% and 50%^ 
these figures on incipient 
attrition make it clear that 
observed rates may be only the 
tip of an ^^attrition iceb'erg. " 
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AS THE CLIMATE FOR INTERINSTITUTIONAL MOBILITY BECOMES MORE FAVORABLE, students are more likely 
to view transfer to another college as a natural, nonthreatening option. Although very few of 
the able students who "leave" a selective college are likely to be "lost to higher education," 
tiey represent very real losses to the college. of original registration, especially if the 
college does not attract its own replacement cohort of transfer students from other colleges. 

EACH COLLEGE CONCERNED WITH ATTRITION MIGHT PROFITABLY RE-EXAMINE TRENDS IN ITS OWN ATTRITION- 
GRADUATION RATE over the past decade, in relation to trends in such theoretically relevant 
factors as college costs and general economic indicators; student mix (ethnic , geographic, 
socioeconomic, sex) ; parietal rules and social regulations; etc. 

THE PROBLEM OF ATTRIJION HAS RAMIFICATIONS FOR BUDGET, ADMISSIONS , COUNSELING, CURRICULUM. 
PLANNING, HOUSING, AND MANY OTHER AREAS OF- INSTITUTIG LIFF. IT IS SUFFICIENTLY COMPLEX TO 
CHALLENGE THE IMAGINATION AND THE RESOURCEFULNESS OF All CONCERNED WITH INSTITUTIONAL PLANNING 
AND DEVELOPMENT. V 

COLLEGES^ - INDIVIDUALLY AND COLLECTIVELY/ NEED TO DEVELOP SYSTEMATIC PROGRAMS FOR MONITORING THE. 
INCIDENCE AND DETERMINING THE ETIOLOGY OF ATTRITION. '^^^ . 



"GRADING IS ONE OF THOSE HORRIBLE ISSUES WHERE EVERYONE HAS A FAVORITE SYSTEM /\ND EVERYONE 
HAS A STRONG FEELING ABOUT IT. THERE IS NO CONSENSUS, NOT EVEN WITHIN THE RANKS OF HUMANISTS 
AND SCIENTISTS." (Dean Horace Taft of Yale College, quoted in the M Times, 9/2^/72.) 

GRADING IS ONE OF THOSE 'HORRIBLE ISSUES' 
fraught with elements of intensely personal 
opinion. It is also an intrinsically com- 
plex isswe with serious ramifications for 
students, professors, and institutions. 
And, both policy and practice with regard 
to the evaluation of student performance 
and the assignment of "grades" are being 
subjected to increasingly critical scru- 
tiny- by all concerned. Questions about 
the "meaning" of grades, and the rationales 
for assigning them, are "topical" on 
every college campus today. 

IN THE FACE OF CHANGES IN THE AVERAGE 
ACADEMIC QUALIFICATIONS OF ENTERING STU- 
DENTS, such as those shown in the figure, 
those concerned with "grades and grading" 
might v^eH ask such questions as these: 

*Jn suacessive classes betb)een 2950 
and 1970, did freshmen at a given 
level of academic ability at entrance 
receive similar grades? 

^Did "grading standards'^ change over the 
period 2958 to 1963? Were the jhanges, if any, plam%ed or unplanned? What about the 
period 1964 - 2970? 

^During these periods, did the ''actual" academic productivity of students vary quat- 
itatively or quantitatively in accordance with variations in their academic cred-- 
entials? Did the typical freshman in 2963 turn in better-organized and -researched 
. term papers, delve more deeply into the svibstance of her courses, or write better 
final examinations than her predecessors in, say, 2958 or 2952? 

■ • V' ■ ' , - . ■ ■ ' 

TENTATIVE ANSWERS TO SOME OF THESE QUESTIONS FOR SEVERAL COLLEGES, and some insight into the " 
complexity of the problem of defining and assessing the ^appropriateness' of grading standards, 
•'are provided by studies of the level of freshman grades awarded by college •f'aculties in relation 
to changes in the level of academic qualifications of students during the pe.n'od 1958 - 1963. 

FOR EACH COLLEGE, this period was characterized by annual increases not only in the scholastic 
aptitude scores of entering freshmen, but also in their measured achievement (average scores on 
CEEB achievement tests) and their school records (secondary-school rank-in-class). 



Did the typical freshman in 1963 write better 
final exams than her predecessor in 1958? 
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■ Scholastic Aptitude 
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TRENDS AT EACH COLLEGE WERE SIMILAR to those - 
shown in detail for College 2, at which the 
typical freshman in 1963 presented higher 
SAT-Verbal and CEEB Achievement Test scores 
than almost 90 percent of her predecessors 
in 1958, along with a higher secondary school 
rank than over two-thirds of them. 

IN -NY GIVEN YEABj STUDENTS WITH CREDENTIALS 
LIKE THOSE OF THE TYPICAL 1963 ENTRANT EARN 
BETTER FRESHMAN- GRADES, ON THE AVEkAGE,. 'THAN 
STUDENTS WITH CREDENTIALS LIKE THOSE ' OF THE 
AVERAGE FRESHMAN IN 19'58, 

KNOWING THE RELATIONSHIP BETWEEN GRADES AND 
ACADEMIC CREDENTIALS, we can determine for 
a given year the average level of freshman 
grades assigned by the faculty to students 
at a given level of aptitude and .developed ^ 
ability (i.e., with a given combination of 

scores on the admissions battery) and thus operationally define a '^grading standard/^ namely, 
''grade-level relative to ability- leveV^ in that year. The figure below shows the average level o 
grades actually awarded in successive classes, 2958-1963^ and the level at which these classes 
would have been graded if the 1958 "grade-level relative to ability -^level" standard had been con- 
sistently applied throughout the period. 
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WHAT DOES THE FIGURE TELL US? 

^The gap between the observed average and 
that expected on the basis of increoi'es 
in student qualifications widened 
steadily. 

^Despite having better qualifications, the 
typical 1963 freshman did not receive 
better grades than her. 1958 predecessor. 

^Given our definition of grading standard, 
these findings indicate that freshmen in 
1963 were being graded according to a' 
more stringent standard than ^ that 
which was applied in 1958. Academic 
assets which would have yielded a divi- 
dend of in 1958, yielded only a 
"C-h'' in 1963. 

IT APPEARS THAT FRESHMEN IN EACH ENTERING • 
CLASS WERE GRADED IN TERMS OF THEIR 
PERFORMANCE RELATIVE TO CURRENT CLASS 
NORMS RATHER THAN IN TERMS OF INDEPENDENTLY 
DEFINED CRITERIA OR STANDARDS. ; 



. . .It appears that the atudentc vho invested their ^tB^t9 in the 1963 
acadealc urket received lower grade-average divideods than those who had 
nade alnilar Investoanta In the 1958 market. 
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THUS, IN SEVERAL LIBERAL ARTS COLLEGES (College 2 and four others), the level of freshman grades 
did not change material ly during one period (1958 - 1963) when these colleges were admitting 
better-qualified students each year. What has happened to freshman grades since the niid-1960's 
.when the upward spiral of selectivity on academic variables levelled off and, in some instances, 
began a downswing? 

NO DATA ARE AVAILABLE ON FRESHMAN GRADES DURING THE PERIOD 1964 - 1971. However, other evidence 
provides reason to believe that the level of grades awarded may have increased during a period 
of stability or decline in student academic credentials [and traditional academic motivation as 
well (CRC NOTES, Vol. 1 , No. 1)]. 

SURVEYS OF SENIORS, CONDUCTED IN 1968 AND IN 2972, PROVIDE SELF-REPORT DATA on the ownulatiVQ 
averages earned by members of the respective classes during college (percent eaiming C, C-h, 
etc.). 

Seniors in 1972 reported better 4-year cumulative grade point averages than 
Seniors graduating in 1972/ those reported t/ seniors in the Class of 1968 at each of six colleges 

reported higher cumulative 
college averages than were 
reported in 1968 by their 
predecessors. 

^In the Class of ^72, at 
six colleges sumeyed, 62% 
of senior women reported 
overages of B or 'better. 
Only mo of the seniors 
surveyed in 1968 repcr '^ed 
overage? of B or better. 

JUDGING FROM THESE FINDINGS, 
some relaxation of standards, in 
the ^'grade-level relative to 
dbility-leveV^ sense, may have 
occurred since the mid-19e0^s, during years characterised by increasingly vocal expressions 
of student discontent at being graded in the traditional, competitive way. 

IN BRIEF, THESE CRC findings strongly suggest that at several liberal arts colleges, grading 
standards have fluctuated over the past 20 years. Examination of grades awarded in relation to 
the level of ability of entering students, suggests that* today ^s freshmen may be facing less 
stringent standards than their predecessors in 1963, but that today's standards, in turn, may be 
tougher than those of 1958 or 1950. 

IT SHOULD BE CLEAR THAT THESE TENTATIVE CONCLUSIONS are based on what may be called '^strong cir- 
cumstantial evidence" requiring a chain pf inferences and assumptions. For example, in concluding 
that the faculty grading standard was more stringent in 1963 than in 19585 we assume that the 
average differences in admissions credentials (scores) between 1963 and 1958 freshmen were associ- 
. ated with average pe rformance differences (as is known to be the case for comparable differences . 
...among groups of students within any given class) , and that conditions of instruction and motiva- 
tion were similar in both years. These are not unreasonable assumptions. 
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HOWEVER, OUR DATA DO NOT DIRECTLY ANSWER THE CRITICAL QUESTION as to whether or not the actual 
level of "student academic productivity or accomplishment" varied directly with the level of 
academic credentials over the years involved. Did the better-qualified freshmen in 1963 tend to 
"perform better" in the academic arena than their predecessors in 1958? If so, should they have 
received better grades? 

SUCH QUESTIONS ARE NOT "MERELY ACADEMIC. " The perspective which would be provided by comparing 
the academic products of "today's" students with those of students of five or ten- years ago, I 
would be valuable to any faculty concerned about the "meaning" of grades. 

MORE GENERALLY, THESE CRC FINDINGS (AND SIMILAR FINDINGS REPORTED BY OTHERS) POINT UP THE NEED 
FOR DEFINING AND USING CRITERIA OR STANDARDS OF STUDENT ACCOMPLISHMENT AND ACHIEm-lENT WHIJJ 
WILL PERMIT EVALUATIONS THAT ARE INDEPENDENT OF ''CURRENT CLASS NORMS, 
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CRC Memorandum . 16 April 1970 



COLLEGE RESEARCH CENTER IS AN AGENCY FOR INTERINSTITUTIONAL COOPERATION IN INSTITUTIONAL RESEARCH. 
Supported from its inception by participating colleges and the College Entrance Examination Board, 
since 1970 CRC has been affiliated with and partially supported by Educational Testing Service. 
As an interinstitutional model, CRC assumes that colleges as a matter of enlightened self-interest 
should develop cooperatively and help support a programmatic pattern of data collection, surveys, 
tests, and. eval'^dtion procedures with (a) sufficient commonality to assure comparability of data 
from college to college, (b) sufficient flexibility to permit each college to meet unique needs 
and interests, and (c) sufficient continuity to pro^jide critically important time perspective for 
the assessment of trends in basic institutional variables and their interrelationships. 



CENTER NOTES SEEKS TO COMMUNICATE ABOUT 
INSTITUTIONAL RESEARCH AND RESEARCH FIND- 
INGS TO COLLEGE FACULTY MEMBERS. Its goal 
is to increase the likelihood that findings 
of research, conducted by CRC and by others 
at ETS and elsewhere, will become part of 
campus discourse on the problems to which 
they are related," and not simply remain 
part of the research literature. 

INQUIRIES ABOUT CRC ARE WELCOMED. 
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